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Headquarters,  U.  S.  Army  Weapons  Command 
Rock  Island,  Illinois 

This  is- the  second  paper  in-the  series  devoted  to  the  subject  of  analysis  of 
risk  for  the  materiel  acquisition  process.  It  It  emphasized  that  risk  analysis 
must  interface  with  decision  analysis  to  facilitate  decision-making  for  major 
developmental  programs.  A  concise  discussion  of  utility  theory,  lotteries, 
and  techniques  to  elicit  utility  functions  is  presented,  as  well  as  a  set  of 
utility  axioms.  The  concepts  are  used  for  the  decision  analysis  of  a  hypo¬ 
thetical  example. 
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I.  INTRODUCTION 

This  is  the  second  paper  in  the  series  devotM  to  the  subject  of 
analysis  of  risk  for  the  materiel  acquisition  process »  In  the  first 
paper  (Hwang ,  1970) ,  the  analysis  of  risk  was  structured  to  show  that 
it  has  close  affinity  to  systems  analysis  and  adds  a  new  dimension*  in 
terms  of  a  probability  measure*  to  integrate  the  three  dimensions  of 
life-cycle  cost*  time  to  complete  acquisition,  and  performance  of  a 
program  in  the  materiel  acquisition  process.  Secondly,  numerous 
applicable  techniques  of  statistical  decision  theory  were  presented, 
including  decision  tree  analysis  and  subjective  judgment  collection. 
Thirdly,  methods  for  risk  analysis  of  the  concept  formulation  and 
contract  definition  phases  of  the  acquisition  cycle  were  exhibited. 

Risk  analysis  has  been  defined  as  the  disciplined  process,  essential 
to  program  decision  making.  Involving  the  application  of  broad  class 
of  qualitative  and  quantitative  techniques  for  analysing,  quantifying, 
and  reducing  the  uncertainties  associated  with  the  realisation  of  cost, 
time,  and  performance  goals  of  large-scale  military  projects.  Decision 
analysis  has  arisen  which  merges  statistical  decision  theory  with  systems 
analysis  (Howard,  1968);  this  is  a  logical  procedure  for  balancing  the 
factors  that  influence  a  decision.  If  decision  analysis  is  properly 
tied  to  risk  analysis,  then  we  have  a  truly  balanced  appraisal  of  the 
project.  To  emphasise  again  the  interfacing  between  risk  analysis  and 
decision  analysis,  we  observe  that  much  information  is  generated 
throughout  the  materiel  acquisition  process.  Particularly  in  the  early 
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phases  of  the  process,  analyses  and  software  techniques  yield 
information  in  terms  -f  the  most  decisive  elements  consisting  of 
cost,  time,  *v  ?  performance  in  some  integrated  measures  such  as 
cost-effectiveness  indices.  It  is  seen  that  althe-,.<>h  the  studies 
flhow  the  materiel  is  cost-effective  over  a  specified  time-frame, 
there  is  usually  very  little  quantitative  information  as  to  the 
aseurance  that  the  program  would  be  successful,  even  given  the 
spus Iflcd  time  and  allotted  the  estimated  cost  resources  needed 
for  cnf  fit::  •<  -ablished  performance  level.  It  is  precisely  this 
missing:  k  that  is  vital  to  program  success.  Analysis  of  risk  is 

designed  to  fill  this  gap, 

Stanford  Research  Institute  has  designed  a  generalized  model  to 
describe  thp  decision  analysis  cycle  as  shown  on  the  following 
page  (Matheeon,  1969),  The  basic  elements  i:i  decision  analysis 
are  summarized  in  three  phases:  deterministic,  probabilistic,  and 
Information.  Interested  readers  can  consult  Spetzler  (1968)  and 
North  <.1968)  for  more  detailed  discussions  and  examples. 

Risk  analysis  is  by  nature  an  Iterative  process  and  must  be 
up-dated  and  validated  at  regular  intervals.  It  has  been  proposed 
that  risk  analysis  be  carried  out  at  least  three  times  in  the 
acquisition  process:  during  concept  formulation,  during  contract 
definitions,  and  prior  to  a  production  decision.  These  analyses 
should  be  coordinated  with  key  decision  points  of  the  acquisition  cycle* 
On  Page  4  is  a  diagram  showing  the  Interface  among  systems  analysis, 
system  engineering,  and  risk  analysis,  relative  to  the  materiel 
acquisition  process. 
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In  the  first  paper,  one  notable  missing  area  is  the  utility 
theory  reflecting  uncertainties,  values,  and  preferences  relevent 
to  a  decision,  The  purpose  of  this  paper  is  to  provide  a  concise 
discussion  of  utility  theory,  lotteries,  and  techniques  to  elicit 
utility  functions.  The  concepts  are  used  for  the  decision  analysis 
of  a  hypothetical  example.  In  particular,  cost-sensitivity  analysis 
(Petruschell,  1968)  has  been  defined  as  the  process  of  d:  permitting 
how  variations  in  the  specifications  of  a  particular  system,  either 
in  design  or  operation,  affect  the  requirements  of  that  system  for 

resources.  The  example  illustrates  the  cost  uncertainty,  thereby 
establishing  the  risks  in  the  decisions. 
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II.  UTILITY  THEORY  AND  LOTTERY 

Utility  is  a  term  interpreted  in  many  different  ways  at  the 
present  time.  In  order  to  establish  a  basis  for  subsequent 
discussions,  a  simple  but  mathematically  concise  set  of  utility 
axioms  is  presented  in  the  Appendix  (Luce  and  Raiffa,  1957).  This 
set  is  one  version  of  utility  theory  originally  created  by 
von  Neumann  and  Morganstern  (1953) ;  another  version  is  found  in 
Ferguson  (1967). 

Consider  three  alternatives,  h^,  hj,  and  h^,  such  that 


hl  5  h2  s  h3  • 


where  "  *  "  denotes  the  relation  "at  least  as  preferred  as".  A  lottery 
is  a  chance  mechanism  which  yields  the  outcome  alternatives  with  the 
known  probabilities  of  occurrences-  We  denote 

(phlf  (1-p)  h3) 

to  mean  a  lottery  with  outcomes  hj  and  h3  with  respective  probabilities 
of  occurrence  p  and  (l-p);  in  dingramatic  form, 

(ph^,  <l.-p)  h3) 


is  equivalent  to 


r 


A 

‘  'i 


4 

ij 

i 

,1 


| 

•* 


Intuitively,  Luce  and  Raiffa  describe  the  nature  of  utility  as 
follows: 

a.  Comparability  -  Any  two  alternatives  shall  be  comparable;  i«  e-{ 
one  alternative  is  preferred  to  the  other,  or  the  two  are  indifferent « 

b.  Transitivity  -  Both  the  preference  and  indifference  relations  for 
lotteries  are  transitive;  i.  e*,  given  three  lotteries  A,  B.  and  C,  if  A 
is  preferred  (indifferent)  to  B,  and  B  is  preferred  (indifferent)  to  C, 
then  A  is  preferred  (indifferent)  to  Cf. 

c.  Rciucibility  -  In  case  a  lottery  has  as  one  of  its  alternatives 
another  lottery,  then  the  first  lottery  is  decomposable  into  the  more 
basic  alternatives  through  the  use  of  the  probability  calculus.  An 
example  is  as  follows:  Consider  a  lottery  of  tossing  a  fair  coin-  The 
coin  is  tossed  a  second  time,  if  it  turned  up  tail  on  the  first  toss. 

The  consequences  are  shown  below: 

$10 


lose  $5 

lose  $15 
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An  equivalent  simple  lottery  Is  ss  follows: 


win  $10 

lose  $5 


lose  $15 

d«  Substitutibility  -  In  any  compound  lottery,  lotteries  are 
interchangeable  if  they  are  equivalent* 

e.  Monotonlcity  -  If  two  lotteries  involve  the  same  two  alternatives, 
then  the  one  in  which  the  more  preferred  alternative  has  a  higher  probability 
of  occuring  ia  itself  preferred. 

f.  Continuity  -  If  A  is  preferred  to  B  and  B  to  C,  then  there  exists  a 
lottery  involving  A  and  C  (with  appropriate  probabilities)  which  is 

e  « 

Indifferent  to  B*  An  example  (Lifaon,  1971)  involves  a  $3  lottery  ticket 
which  pays  off  $10  or  wins  nothing.  The  player  has  the  choice  of  either 
purchasing  the  ticket  or  not  playing*  Whether  the  player  decides  to  play 
or  not  is  dependent  upon  his  preference.  To  quantify  his  preference  as 
to  the  $3,  we  consider  a  simple  lottery  where  100  slips  of  papers  numbered 
from  1  through  100  are  placed  in  a  hat.  The  following  table  tallies  the 
player's  preference: 
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Win  $10  if 

No.  Drawn  is  in 
the  Set 

Win  Nothing  if 

No.  Drawn  is  in 
the  Set 

Probability 
of  Win 

Player's 

Preference 

1 

2-100 

.01 

$3 

1-2 

3-100 

.02 

$3 

1-3 

4-100 

.03 

$3 

1-4 

5-100 

.04 

$3 

• 

• 

a 

d 

• 

• 

a 

n 

a 

a 

a 

i» 

1-97 

98-100 

.97 

Lottery 

1-98 

99-100 

.98 

Lottery 

1-99 

100 

.99 

Lottery 

1-100 

1.00 

Lottery 

There  is  sone  point  in  the  table  that  the  player  is  indifferent  as  to 
the  $3  or  the  lottery. 

Let  A  be  the  outcome  of  wining  $10, 

B  be  the  outcome  of  keeping  $3, 
and  C  be  the  outcome  of  losing  $3. 

Outcome  A  is  preferred  to  B,  and  B  to  C.  The  preceding  lottery 
involving  A  and  C,  plus  the  probability  associated  with  the  indifference 
point,  is  what  the  continuity  property  means. 

Basically,  there  are  two  types  of  simple  lotteries.  Given  outcome 


h^,  h2,  and  such  that 


hi  55  h2  *  h3 
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4 

X 

•3 


& 

I 

$  A  decision  make?  is  fscsd  with  the  following  choicest 

| 

l  Choice  as  h-  with  certainty 

|  £ 

I  Choice  bs  Oh,,  (1-p)  h  ) 

t  x  3 

( 

\  In  diagramatic  fora,  the  choices  are  as  shown  below: 


Lottery  1:  The  decision  maker  is  to  establish  p  so  that  he  is  indifferent 
as  to  choices  a  and  b,  The  example  presented  on  page  9  is  this  kind 
of  lottery* 

Lottery  2:  The  decision  maker  is  to  establish  so  that  he  is 
indifferent  as  to  choices  a  and  b.  An  example  of  this  kind  of 
lottery  is  shown  next. 


Utility  Function  Determination 


Prof.  Ralph  Swalm  of  Syracuse  University  (1971)  designed  a  simple 


experiment  to  determine  an  individual’s  utility  function.  On  psge  13  is  a 
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I  form  which  facilitates  the  utility  function  determination *  An 

% 

’  individual  is  asked  to  choose  between  an  alternative  which  leads  to  a 

i * 

f  certain  gain  (or  loss)  of  a  known  amount  and  another  alternative  which 

i  could  lead  to  either  of  two  outcomes'  It  is  assumed  that  all  income  or 

losses  will  take  place  in  the  very  near  future ,  with  all  amounts  considered 
after  taxes-.  The  individual  is  acting  in  the  capacity  of  a  decision 

I 

making  of  corporate/office  funds,  not  private  funds*  Also,  the  responses 
should  represent  the  actual  action  one  would  take  if  the  alternatives  are 
presented  today,  not  what  one  feels  he  should  do,  not  what  might  be 
expected  to  be  done* 

Conceptually,  the  questions  asked  are  of  the  following  form; 

Suppose  two  alternatives  are  posed.  The  first  involves  undertaking 
to  bid  on  a  new  project.  If  the  bid  is  successful,  the  office  makes  a  net 
profit  of,  say,  $100,000-.  If  unsuccessful,  the  costs  fo?  making  the  bid 
is  reimbursed,  but  the  net  gain  is  zero.  The  best  available  information 
leads  to  assign  a  50-50  chance  to  the  above  events - 

The  second  alternative  is  to  put  the  manpower,  instead  of  making  the 
bid,  into  cost  reduction  efforts  Based  on  past  experience,  it  is  certain 
that  this  would  result  in  a  net  gain-  How  ’arge  would  this  gain  have  to 
be  to  make  one  indifferent  as  to  which  alternative  to  take?  In  other  words, 
at  what  certain  income  would  one  be  lndifferen  to  the  office  s  gam  or 
getting  a  50-50  chance  of  making  $100,000  or  nothing? 

Other  questions  can  be  constructed  such  as  the  following. 

Suppose  the  company  is  being  sued  for  x  dollars,  and  the  probability 
of  losing  is  502,  What  amount  of  x  v;ould  you  be  willing  to  pay  to 
settle  out  of  court? 
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Automated  lotteries  are  available  where  the  decision  maker  can 
converse  with  a  computer  and/or  graphic  unit  to  establish  the  utility 
functions.  One  system  is  called  "Lexicoder"  of  Lex  Computer  Systems,  Inc 
Palo  Alto,  California. 
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UTILITY  FUNCTION  DETERMINATION 


1.  A 


2,  B 


3.  C 


4.  A 


5,  E. 

6.  F 


7.  A 


8,  C 


or  Zero 


or  Zero 


or  Zero 


or  Zero 
or  Zero 


AMOUNT 


vs  Zero 


UTILES 
+8 
'  +4~ 

'  +2~ 

. . ‘+1 

. ~  -8 

-2 

’  jT 
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m,  an  example 

Utility  concepts  have  been  applied  to  Industrial  problems 
(Matheson,  1969;  Spetzler,  1968;  Howard,  1966).  There  is  a  lack  of 
case  studies  in  the  Defense  Department.  The  example  presented  below 
is  Intended  to  illustrate  some  key  features  of  utility  theory  applied 
to  the  defense  acquisition  process.  It  is  a  hypothetical  example 
constructed  by  the  author  who  is  solely  responsible  for  the  accuracy 
of  the  contents.  The  approach  is  similar  to  an  example  by  Kaufman  (1970) , 
The  example  is  concerned  with  the  air-armament  of  two  aircraft 
denoted  by  A1  and  A2,  Two  gun  candidates  are  available  to  fulfill  the 
air-armament  role;  these  two  gun  candidates  are  denoted  by  Gl  and  G2, 

On  performance  and  effectiveness  alone,  G2  is  superior  to  Gl,  Aircraft 
Al  can  accept  either  gun.  Aircraft  A2  can  accept  Gl;  should  G2  be 
adopted  for  it,  a  major  redesign  is  required  in  the  gun  turret,  as 
well  as  the  aircraft  structure.  On  the  other  hand,  Gl  is  more  readily 
available  than  G2  and  is  less  costly.  The  objective  is  to  evaluate  the 
two  guns  with  respect  to  cost,  time,  performance,  and  risk  so  as  to 
determine  the  most  suitable  gun  system  for  application  to  the  aircraft. 

With  two  guns  and  two  aircraft,  there  are  four  possible  combinations. 
We  identify  these  four  combinations  as  four  distinct  performance  levels 
shown  below. 

Guns  Applied  to  Aircraft 

Performance  Level  Al _ A2 


1 

Gl 

G2 

2 

Gl 

Gl 

3 

G2 

G2 

4 

G2 

Gl 
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From  a  qualitative  standpoint,  an  overall  comparative  analysis 
can  be  presented  in  a  matrix  shown  below: 


EVALUATION 

AIRCRAFT  Al 

AIRCRAFT  A2 

DIMENSION 

01 

G2 

G1 

G2 

Cost 

Good 

Good 

Good 

Fair 

Time 

Good 

Fair 

Good 

Poor 

Effectiveness 

Good 

Very  Good 

Good 

Good 

Risk 

Low 

Low 

Low 

Medium 

i 

| 

* 

l 

c 

\ 

jf 

i 

i 
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Although  this  matrix  reveals  the  qualitative  comparison  among  the 
various  contenders  with  respect  to  the  evaluation  dimensions,  it  does 
not  facilitate  a  quantitative  trade-off  for  decision-making ,  We  will 
now  proceed  with  the  decislon/rlak  analysis  through  a  cost-sensitivity 
analysis,  a  simplified  decision  model,  and  a  refined  decision  model  to 
effect  a  quantitative  comparative  analysis* 

Cost  Model 

From  a  cost  analysis  with  supporting  cost  rationale,  a  cost  model  is 
constructed  by  regression  analysis.  This  model  relates  total  life-cycle 
costs  of  guns  to  quantities  of  aircraft,  armed  with  the  guns  and  also  of 
mixes  of  two  guns  on  two  aircraft* 

g 

Suppose  na  represents  the  quantity  of  o-aircraft,  and  c£  represents 
total  life-cycle  cost  of  B-gun  applied  to  a-aircraft*  The  equations 
for  costs  in  $-millions  are  as  follows: 


V 


CA1  <nAl)  "  °'13*3  nAl  +  15,6» 

CA1  (°A1>  *  0,0837  °A1  +  17b3» 

c£  toA2>  "  °-1343  »A2  +  15>6> 
c“  (nu)  -  0.0837  ,42  +  10.8  4ct, 

where  c  r^-vesents  the  turret  development  cost  for  G2  applied  to  A2, 
£ 

15 
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I  For  the  four  combinations  of  performance  levels,  total  life-cycle 

|  costs  of  guns  in  $-millions  for  arming  two  aircraft  are  tabulated  below* 

|  Performance  Total  Cost  to  Arm  Duplicating  Modification 

Level _ Coat _ A1  _ A2  Fixed  Coat  Cost 


V 

l 

1 

c 

1 

62 

*  CA1 

<nAl>  + 

G1 

CA2 

*nA2> 

\ 

2 

c 

2 

G1 

"  CA1 

<-nu)  * 

cG1 

A2 

<°A2> 

-  5«0 

3 

c 

3 

G2 

"  CAl 

(nA1)  + 

G2 

CA2 

-  6.9 

+  c 

m 

c 

4 

G1 

CA1 

* 

G2 

CA2 

+  c 

m 

where  c  is  the  modification  cost  which  has  not  been  estimated  accurately* 
m 

For  performance  levels  2  and  3,  the  same  gun  is  applied  to  both 
aircraft;  hence,  a  duplicating  fixed  cost  must  be  substracted  from  the 
total  cost. 

From  the  above,  cost  sensitivity  can  be  checked  on  c  and  c^  to 
derive  some  criteria  which  are  critical  to  the  decision.  Assuming  cost 
dominance  for  the  above  four  mixed  life-cycle  costs,  we  can  easily  derive 
some  criteria.  The  derivation  of  these  criteria  is  simple;  we  begin  with 
the  cost  dominance,  substitute  the  cost  equations  for  the  dominant 
behavior,  solve  for  the  quantities  n^  and  n^*  and  arrive  at  the 
criteria  shown  on  the  next  page. 
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Cost  Dominance 


Criteria  (c  =c  +  c. ) 

a  n  t 


c  <  c 
1  "  2 


1.  nA1  >  130 


c  <  c 

2-3 


2.  n.,  +  n.«  <  25  +  20c 
A1  AZ  “  8 


C  <  C 
1  *  3 


3.  nA2  <  20cg  -  110 


c  <  c 
3“4 


4 .  always  tree 


c  <  c 
2-4 


5,  n.0  <  130  +  20c 

AZ  “  S 


c  <  c 
1  -  4 


6-  “/a :  n*i +  20s 


Criteria  4,  5,  and  6  are  not  as  stringent  as  criteria  1,  2 ,  and  3* 


As  we  like  to  have  the  above  cost  dominance  behavior,  we  search  for 
aircraft  quantity  mires  which  satisfy  the  first  three  criteria,  and 


R-  S;, 

h  ?! 

fc>  si 


I  t 

I  i 


we  can  ignore  the  criteria  4,  5,  and  6,  This  is  done  by  plotting 

nAl  ver8u8  nA2  unc*er  the  three  constraints,  plus  the  following 

estimate  for  c  : 

8 


10  <  c  <  26,4  , 

—  8  “ 


»  VaT.v? lift*  Z.  lAjKvjfcZj fcsjj&a - Ajis  — i.1 ' 


•c?r>*TJR*^v^F  y^r-*7*^^  ^**z\ f-^v^>^i'j *l> •  ^ysTs^-v'Vw.^ 


The  shaded  area  in  the  following  diagram  represents  all  feasible 
combinations  of  aircraft  satisfying  the  three  constraints. 


m 


i 
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Decision  Model 

Acquisition  tines  in  months  up  to  the  end  of  Engineering 
test  jrvice  Test  (ET/ST)  for  the  respective  guns  with  the  aircraft 
are  as  follows. 


Gun 


Aircraft  A1 


Aircraft  A2 


G1 

G2 


19 

22 


19 

28-60 


Since  the  turret  development  and  aircraft  mi iificatlon  are 


uncertain  for  G2  applied  to  A2,  the  cost  c  and  time  t  are 

rr  *  s  g 


assumed  as  two  random  variables*  Subjective  probability  density 
function  p  are  solicited.  Let  the  probability  density  functions 
be  of  the  following  shape) 


/ 

/ 


4 - ! 


28  36 


44 


52  60 


19 


■s 

I 


1 

>s 


Based  on  these  probability  density  functions)  we  can  calculate  the 


expected  values  for  c  and  t  ,  denoted  by  E(c  )  and  E(t  )  , 

S  8  8  8 

respectively.  Since  p£  is  symmetric  about  18.2, 

E(c  )  -  18.2  . 
s 

The  density  function  is  fitted  by  a  beta  density,  i.e«, 

f(x)  -  x^d-x)^1  ,  0  <  x  <  1,  p,q  >  1. 

Setting  p-2  and  q«4,  we  obtain 
pt(x)  -  20x(l-x)3  , 

where  t  *  32x  +  28,  and 
8  ’ 

E(ts}  •  f  fcs  pt(ts)dts  "  38*7* 

0 
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At  this  tins |  we  shall  apply  the  utility  concepts  to  resolve  the 
problem*  Assuming  the  reader  is  not  totally  familiar  with  the  utility 
scheme*  we  approach  the  decision  analysis  in  two  parts:  first*  a 
simplified  version;  secondly*  a  more  complete  analysis*  Both  parts  are 
concerned  with  one  feasible  combination  consisting  of  575  aircraft  with 
375  A2  and  200  Al*  This  combination  is  within  the  cost  dominance  solution 
set  in  the  cost  model* 


Simplified  Model 

The  basic  decision  problem  at  hand  is  as  she  *  below  in  the  diagram* 
It  is  assumed  that  any  one  of  the  three  performance  levels  is  achievable. 


5 


(3,  38.7,  87.8) 


(2,  19,  96) 


(1,  22,  93.5) 


The  $3.2  million  is  the  toll  for  developing  both  guns  concurrently* 
for  parallel  development  requires  an  additional  initial  $3*2  allotment 
of  R&D  funds.  If  the  $3*2  million  is  not  allotted  initially*  then  only 
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the  performance  levels  2  and  3  can  be  pursued.  If  $3.2  million  can  be 
funded,  then  this  $3.2  is  included  in  the  total  life-cycle  cost  for  that 
performance  level. 

The  triples  for  the  three  levels  represent  the  performance  level, 
acquisition  time,  and  total  cost  for  the  three  outcomes.  Performance 
level  4  is  not  in  the  decision  tree,  as  all  three  performance  levels 
dominate  that  level,  provided  t  and  c  are  close  to  the  expected 
values. 

To  facilitate  utility  assessment,  we  first  reduce  the  dimensions 
in  the  triples  by  eliminating  the  time  dimension  so  that  all  times  are 
on  one  equivalent  time  basis.  It  is  also  assumed  that  there  is  no 
time  constraint;  otherwise,  the  constraint  would  reduce  the  number 
of  possible  routes.  To  accomplish  this  reduction  process,  we 
construct  the  so-called  time-cost  indifferences  curves  by  posing 
preference  questions  to  the  decision-makers  as  follows: 

For  performance  level  2,  do  you  prefer  time-cost  pair  1  or  pair  2? 

Time-cost  Pair  1  Time-cost  Pair  2  Choice 


(19,96) 

(19,96) 

(19,96) 

(19,96) 

(19,96) 

(19,96) 


(38.7,90) 

(38.7,75) 

(38.7,50) 

(38.7,60) 

(38.7,65) 

(38.7,62) 


1 

1 

2 

2 

1 

indifferent 


In  this  fashion,  time-cost  indifference  curves  can  be  generated  as  shown 
in  the  following  plot. 


•&****> 


'  *  "•  5**| 


(2,62)  is  indifferent  to 


After  a  series  of  lottery,  we  would  have  the  utilities  of  all  the 
outcomes  as  follows. 

Outcome  (p,c)  u(p,c)  in  utiles 


(1,62) 

(1,64) 

(2,62) 

(3.87.8) 

(2.87.8) 


1.00 

.95 

.75 

.50 

0.00 


Hence,  the  decision  problem  lias  been  quantified  with  the  utilities  of 
pursuing  performance  levels  1,  2,  and  3,  being  .95,  .75,  and  .5, 


/ 


respectively. 


Refined  Model 

Now,  the  analysis  is  carried  out  a  second  time  to  include  major 
critical  milestones.  From  the  technical  risk  analysis,  information  is 
gathered  so  as  to  interface  with  the  decision  analysis.  Specifically, 
careful  assessment  of  the  problems,  consequences  of  failure,  and 
judgment  of  effort  needed  for  a  practical  solution  highlighted  such 
problems  for  the  G2  applied  to  A2  as  projectile  cook-off,  maintainability, 
recoil  and  blast,  aluminum  cartridge  case,  G-load,  and  structural 
modifications.  Key  milestones  Include  Research  &  Development 
Acceptance  Test  (RDAT)  and  ET/ST.  The  next  page  shows  a  decision-tree 
reflecting  the  major  program  milestones.  Risk  nnalvsis  contributed 
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to  the  establishment  of  the  probabilities  of  occurrences  at  each  event 
fork.  Outcome  triples  of  performance  level,  time,  and  cost  are  also 
shown  at  the  terminal  nodes.  It  is  noted  that  if  the  development  is 
completely  successful,  we  have  an  outcome  a.  If  it  is  completely 
unsuccessful,  then  outcome  f  results,  with  G1  as  the  back-up  gun 
system  for  A2.  If  minor  problems  are  encountered  at  RDAT  or  GT/ST, 
then  a  delay  occurs  which  calls  for  additional  time  and  resources; 
timely  resolution  would  yield  outcomes  b,  d,  and  e.  Otherwise  a 
decision  for  applying  the  G1  to  A2  results,  and  outcomes  c  and  e 
are  realized.  Outcomes  g  and  h  are  simply  the  other  two  approaches. 

Again,  similar  to  the  technique  in  the  simplified  model,  we  begin 
by  the  reduction  of  the  triples  to  only  two  dimensions  by  eliminating 
the  time  dimension.  Two  sets  of  time-cost  indifferences  curves  are 
shown  below  with  one  set  for  the  performance  level  1  and  another  for  3. 
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By  using  the  time-cost  indifference  curves,  we  ascertain  the  equivalent 
outcome  set  shown  below,  based  on  38.7-month  reference  time  frame. 


Outcomes 


Equivalent  Outcomes 


a 

b 

c 

d 

e 

f 

g 

h 


(3,38.7,87.8) 

(3,87.8) 

(3,46,90.8) 

(3,96) 

(1,46,90.8) 

(1,105) 

(3,46,90.8) 

(3,96) 

(1,53,93.8) 

(1,125) 

(1,38.7,87.8) 

(1,87.8) 

(2,19,96) 

(2,62) 

(1,22,93.5) 

(1,64) 

Next,  we  assess  the  utilities  of  these  outcomes  and  apply  the 
concept  of  "averaging  out  and  folding  back"  (Raiffa,  1968). 

Let  the  utility  function  of  performance  level  p  and  cost  c 
be  in  terms  of  the  best  possible  outcome  and  worst  outcome. 


u(p,c)  ■  v(p)u(l,c)  +  (1  -  v(p))u(2,c) . 
u(l,c)  -  x(c)u(l,c*)  +  (1  -  x(c))u(l,c*), 
u(2,c)  -  y(c)u(2,c*)  +  (1  -  y(c))u(2,c*) , 


62  and  125,  respectively.  To  obtain  these  utility  functions,  it  is 
necessary  to  establish  four  sets  of  lotteries. 


u(p,c) 

Then 

u(l,c) 

and 

u(2,c) 

where 

c*  is  the 
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Lastly,  the  fourth  set  of  lotteries  results  in 

u(l,c^)  *  .1  and  u(2,c*)  *  0.75. 

These  utilities  are  now  combined  to  find  u(p,c)  by  the  utility 
equations  and  the  lottery  outcomes: 


V  "l 

i  1 

?  1 

ri  i 

t  \ 

c 

u(l.c) 

u(2>c> 

u(3,c) 

62 

1.0 

.75 

.875 

? 

k  ‘ 

’*  V 

f,  * 

64 

.955 

.7275 

.841 

1  i 

:* 

87.8 

.64 

.4875 

.564 

ft 

y 

| 

96 

.37 

.2625 

.316 

r 

105 

.19 

.1125 

.151 

1 

125 

0.0 

0.0 

0.0 

These  utilities 

Outcomes 

a 

b 

are  used  to 

find  the  utilities  of 

Utilities 

.564 

.316 

the  outcomes 

c 

d 

e 

f 

g 

h 


.19 

.316 

0.0 

.64 

.75 

.955 


To  fold  back,  we  start  from  the  terminal  nodes,  multiply  the  utilities 
at  terminal  nodes  with  the  respective  probabilities  of  occurrence,  and  sum 
at  each  event  fork.  Utilities  of  the  event  forks  are  folded  back  by  again 
multiplying  the  utilities  with  the  respective  probabilities  of  occurrences 


Is 
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and  summing.  This  process  is  repeaced  to  the  initial  decision  node,  and 
we  can  find  the  expected  utilities  of  the  three  performance  levels.  In 
similar  fashion,  we  can  fold  back  the  costs  and  times. 

Performance  Level  Expected  Cost  Expected  Time  Utilities 


1 

93.5 

22 

0.96 

2 

96 

19 

0.75 

3 

88.8 

40.7 

0.5 

At  this  point,  the  "averaging  out  and  folding  back"  technique  shows 
that  the  expected  utility  for  performance  level  is  highest;  the  second 
level  second  best;  and  the  third  level  third.  The  decision-maker 
established  a  quantitative  comparison  among  the  three  alternatives 
with  betting  odds  of  96  to  75  to  50  for  performance  levels  1,  2,  and  3, 
respectively.  A  qualitative  comparative  analysis  has  been  transformed 
to  a  quantitative  one,  and  a  decision-maker  should  pursue  according  to 
the  preference  pattern  above. 
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IV.  CONCLUSION 

In  this  paper,  it  is  emphasized  that  risk  analysis  must  interface 
with  decision  analysis  to  facilitate  decision-making  for  major  develop¬ 
mental  programs  in  the  materiel  acquisition  process.  Risk  analysis 
contributes  to  uncertainties  resolution,  decision- tree  structuring. 


and  probabilities  of  occurrences  of  major  program  events  through  the 
assessment  of  problems,  consequences  of  failure,  and  judgment  as  to 
effort  needed  for  a  practical  solution.  The  utility  concept  plays  a 


significant  role  in  the  quantification  of  preferences  and  subjective 
judgment.  A  risk  analysis  is  complete  only  if  these  two  areas  are 
properly  tied  together. 

At  this  time,  a  complete,  well-documented,  real-life  case  study 
of  a  major  developmental  program  is  still  very  much  needed  to  bridge 
the  credibility  gap. 
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APPENDIX 


Utility  Axioms 


Consider  a  finite  exhaustive  set  of  mutually  exclusive  outcomes  h^, 
ieN,  where  N  is  some  initial  segment  set  (i  »  1,  2,  . ..,  n).  The 
set  of  outcomes  can  be  denoted  by  an  n- tuple: 

<hi»  h2*  *••»  V  *  H* 


Also,  for  i  +  j,  i, jeN, 


h^llh^  •  0. 

Suppose  for  each  outcome  h^,  a  probability  p^  is  known  to  exist  such 
that  for  each  i,  ieN, 


i.  0  <  p1  <  1, 


ii.  I  p  »  1. 

J  *• 


iii.  Probability  (h^Uh^)  »  p^+p^ , 


i  j*  j,  i,jeN  the  set  of  probability  can  also  be  denoted  by  a 
corresponding  n- tuple: 


(pj»  P2*  •••»  P^)  = 


A  lottery  is  a  chance  mechanism  which  yields  H  with  the  known  P 
over  N. 


a, s*^ •  V" *T~ w  5s? 


^*>*<^*’*w  ^ v--> .  *  ■*  .?f-  _*y~ .■*■* k&< 


Notation:  A  lottery  L  is  denoted  as  an  n-tuple: 


L  -  (pjhj,  p2h2,  ....  pnhn), 

where  one  and  only  one  outcome  h^  will  be  realized  and  the  probability 
that  it  will  be  h^  is  p^. 


The  concept  of  preference  is  prescribed  by  the  relations  defined 


below. 


Definition  1:  In  1  +  j,  i,jeN, 

1.  h^  >  hj  denotes  h^  is  at  least  as  preferred  as  h^. 

ii.  h^  >  hj  denotes  h^  is  preferred  to  h^. 

iii.  h^  ~  hj  denotes  h^  is  equivalent  (or  indifferent)  to  h^. 

Axiom  1;  (Comparability)  For  i,j  N,  i  ^  j,  only  one  of  the  following 


holds: 


i.  h±  >  hj 
ii.  hj  >  ht 


Both  relations  are  true  simultaneously  provided  h^  -  h^ , 


Notation:  From  here  on,  H  will  be  arranged  such  that 


h  >  h,  }  h,  >  *••  >  h  . 
i  £  3  n 


Axiom  2:  (Transitivity)  If  h^  >  h^ ,  and  h^  >  h^,  i,j,keN,  then 


hi>hk 


Axiom  3:  (Transitivity)  Preference  and  Indifference  among  lotteries 
are  transitive  relations. 


i.k.  ililfsil*-'! .ii 


?s?¥44flF?&  w^<ww?iW^ 
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Axiom  4;  (Continuity)  Suppose  hj  >  h^  >  hn»  i  N.  There  exists  a  real 


number  u^,  0  <  u^  <  1  such  that 


hi  '  (u^j ,  (l-u1)hn) . 


Axiom  5:  (Substitutability)  If  h^  ~  h*,  then 


(Plhl»  P2h2*  •**’  pihi’  **•»  pnV 

-  (Pjhj ,  p2h2,  ••♦,  pjh*,  ♦•♦,  PQhn). 


Axiom  6;  (Reducibility)  A  compound  lottery  can  be  reduced  to  an 


equivalent  simple  lottery  with  outcomes  hj,  h2,  ••*,  hn»  their 


probabilities  computed  according  to  ordinary  probability  calculus. 


Theorem:  A  lottery  L  can  be  transformed  into  another  lottery  L' 
such  that 

a.  L'  involves  only  h,  and  h  . 

J  1  n 


b.  L'  -  L. 


Proof : 


By  the  continuity  axiom,  there  is  u.^  for  each  h^  such  that 


hj  ~  (u^hj , (l-u^)hn) . 


By  substitution,  each  h^  can  be  replaced  accordingly: 


’  (plhl-  p2h2>  •*  pihi>  •••’  PnV 

~  ((PjUjhj,  PjU-u^h^,  (PjUjhj,  p2(l-u2)hn), 

(piu1h1 >  pi(l-ui)hn),  •••, 

(p  u  h, ,  p  (1-u  )h  )) 

*n  n  i*  *n  n  n 
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By  reduction  of  compound  lottery  axiom,  to  only  h1  and  h^, 


L’  *  ((p^  +  p2h2  +  •••  +  Piui  +  •••  +  Pnun)h!» 

(PjU-v.j)  +  p2(l-u2)  +  •••  +  Pi(l-ui)  +  •••  +  pn(l-uR))hn) 


n  n 

(h  £  p  u.,h  (1  -  £  p.u.))  -  L. 

i-1  i-1  1  1 


Axiom  7:  (Monotonicity)  Consider  two  lotteries 


L  «  (ph1 ,  (l-p)hn)  and  L  -  (qhj,  (l-q)hn>. 


Lp  ;>  if  and  only  if  p  >  q. 


Definition:  A  utility  of  an  outcome  in  a  lottery  L  is  a  measure 


uA  such  that  the  preference  or  indifference  relationship  satisfies  the 
above  axioms. 


For  two  lotteries  L  and  L  such  that  utility  measures  {u. } 

p  q  1 


P  q 

associated  with  the  basic  outcomes  have  been  determined,  the  preferences 


for  the  lotteries  are  reflected  by  the  following: 
n 


p  «  £  p  u 

i-1  1  1 


and 


n 


p  ■  £  q,u,, 
i-1  1 


where  p  and  q  are  callec  expected  utilities  of  the  lotteries  L 


and  L^,  respectively. 


Theorem:  A  linear  transformation  does  not  affect  the  relative  preference 
rankings  among  lotteries. 
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